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We develop a comparative thermodynamic theory, based on master-equation description of 
driven chemical reactions, for quasi-steady-state (QSS) and open-system nonequilibrium steady- 
state (NESS) sustained by chemical potential difference. The two processes have identical kinetics 
but different thermodynamics: Using motor protein as an example, we find that the difference in heat 
dissipation is the minimum work that needed for an external energy regenerating system that keeps 
the NESS (e.g., sustains constant concentrations of ATP, ADP and Pi). The entropy production 
rate in the NESS equals to the rate of decreasing free energy in the QSS of the corresponding closed 
system. For systems approaching an NESS, the non-negativity of the rate of relative entropy change 
gives rise to the concept of housekeeping heat. This theory shows consistency and contradistinctions 
in thermodynamics of energy transduction and heat dissipation in the two different perspectives of 
nonequilibrium systems, a la Clausius and Kelvin. Furthermore, it suggests new thermodynamic 
ingredients of self-organization in driven systems. 
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Statistical thermodynamics is the mathematical foun- 
dation of our material world in terms of classical physics, 
on which modern chemistry and biology stand [l|. To 
address the fundamental issues in complex living organ- 
isms such as a cell, there are currently two different per- 
spectives: A classical physicist maintains a world follow- 
ing the Second Law of Thermodynamics and considers 
a living organism as a subsystem in a quasi-stationary 
state, due to the the slow changing nature of its envi- 
ronment; engineers and cellular biologists consider the 
complex systems in a sustained environment which has 
to be maintained. How to maintain such environment, 
however, is not a concern to someone who is interested 
in the internal, complex dynamics. 

This distinction can be best illustrated by two types 
of laboratory experiments on a motor protein 2] , which 
convert chemical energy from ATP hydrolysis to mechan- 
ical work. In the first type, the amount of ATP, ADP and 
Pi are not controlled. However, due to the excess nature 
of their amount in solution, their concentrations can be 
considered approximately constant over the entire dura- 
tion of a single-molecule experiment. Nevertheless, if an 
experiment is prolonged for a sufficiently long time, the 
ATP and ADP+Pi will eventually reach their chemical 
equilibrium, and the motor protein will cease to execute a 
directional motion. In the second type of experiments, an 
ATP-regenerating system is coupled to the motor protein 
Q. In this case, the motor protein, as an open chemical 
system, can reach a nonequilibrium steady state (NESS) 
while continuously move along its track, even with a con- 



stant load mm. 

In the past, this experimental distinction has not at- 
tracted much consideration from theorists since in the ki- 
netic theories of motor proteins [2], both QSS and NESS 
treatments assume time-independent, constant concen- 
trations of ATP, ADP and Pi, leading to identical pre- 
dictions. 

However, the thermodynamics of the two setups are 
different: In the QSS, the heat associated with each ATP 
hydrolysis is its AH; i.e., enthalpy (or internal energy 
for system with constant volume) change. But in the 
NESS, the amount heat dissipated is the AG of ATP 
hydrolysis! A consistent thermodynamic theory, thus, is 
needed to clarify the issues. The theory will naturally 
deduce NESS thermodynamics of an open system from 
thermodynamics of quasi-stationary transient processes 
in a closed system. A comparative study of QSS and 
NESS nonlinear dynamics can be found in [6j. 

A simple cyclic reaction system coupled with a 
regenerating system — Fig. [1] shows a simple bio- 
chemical reaction cycle B — > C — > B coupled to ATP 
hydrolysis. The ATP, ADP and Pi concentrations are 
maintained by an "external" regenerating system: 



B + ATP % C + ADP, C ^ 



B + R. 



(1) 
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After completing a reaction cycle (fT]), the net effect is 
one ATP being hydrolyzed to ADP+Pi. At the mean- 
time, the regenerating system would convert ADP+Pi 
back to ATP externally. This is the essential difference 
between NESS and QSS which results in one ATP hy- 
drolysis after one cycle. Standard thermodynamics tells 
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FIG. 1: The thermodynamics of spontaneous ATP hydrol- 
ysis and related ATP regenerating process. For net ATP 
hydrolysis reaction, Afi = Ah" - TAs" + k B T\n ^p§pp 
= — fcsTln7 < 0. Each hydrolysis reaction absorbs the 
amount of heat of Ah° . In general, reaction Ah" can be either 
positive (endothermic) or negative (exothermic). Associated 
with the reaction is also the change of configurational entropy 
As" between a molecule ATP and the products ADP and 
Pi. The last term is entropy change associated with changing 
concentrations. Because of A[i < 0, the regenerating pro- 
cess can not be spontaneous. In fact, a minimal amount of 
work, — A/x is required to synthesis an ATP from ADP + Pi, 
at the given concetrations. Furthermore due to energy con- 
servation, this synthesis process also release amount of heat 
TAs" + fcsTln . The entire cycle, therefore, has an 

— Afi > amount of work input and the same amout of heat 
dissipated. 



us the chemical potentials of each species are defined as 

MB =i>°B + k B T\n[B], fic=^c + k B Tln[C], 

Hatp = V°atp + k B Th\[ATP], 

(J- adp = P°adp + k B Tln[ADP], 

lip t = li Pt + k B Thi[Pi]. (2) 

At chemical equilibrium, fi B + Hatp — Mc + i^ADP and 
Mb + Mp* = Mc, i.e. fci[B] e9 [ATP] e ? = k^Cf^ADP]^ 
and k 2 [C] eq = fc_ 2 [-B] e<z [-Pi] e<z , which also leads to the 
thermodynamic relations 



Mb + Matp 



u adp 



k B T hi (h/k-t), (3) 
Mb-Mp, = fe s Tln(fc 2 /fc_ 2 ). (4) 

Each intrinsic chemical potential can be decomposed into 
fx = h — Ts°, where h and s° are the intrinsic enthalpy 
and entropy respectively. Then for a single occurrence of 
the hydrolysis cycle in Fig. [TJ the heat dissipation is 

hd = {h° B + h° ATp - h a c - h° ADP ) + {h° c - h P . - h° B ) 



11 ATP 



n ADP 



(5) 



There is an "external step" for the regenerating system 
converting ADP+Pi back to ATP after each completion 
of a cycle. The minimum work it has to do is the free 
energy difference between ADP+Pi and ATP, i.e. 

W min = [1ATP ~ HADP - HPi, (6) 

with corresponding enthalpy changes from h ADP + h° P . to 
hP ATP . Therefore, the energy dissipation of this external 
step in the environment, in the form of heat, is 
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We note that h d xt is just the entropy change for the ATP 
hydrolysis. 

Hence the total heat dissipation of a single forward 
biochemical cycle in a drive system with regeneration is 



W„ 



HATP ~ [i-ADP - HPi = k B T\nj, 



where 7 = fc ^^[adpIip-] > 1 i s the affinity for the 
reaction cycle. The affinities has a clear thermodynamic 
meaning in such a driven cycle, and all the external work 
is dissipated while the system remaining steady. 

We see the central importance of cycle kinetics from 
this simple example. Before a completion of a cycle, the 
regenerating system needs not to do anything to maintain 
the environment, and all the work done to "the system" is 
potentially reversible. This has been emphasized by T.L. 
Hill; a similar argument was put forward by Landauer 
for the thermodynamics of computation Q. 

Master equation model and thermodynamic 
constrains — The above analysis for a single biochem- 
ical cycle can be generalized to dynamical models with 
master equations: Let us consider a motor protein with 
N different conformations Ri, R%, ■ ■ ■ , Rn- Suppose that 
the system is kept in a close contact with a large heat 
bath with constant temperature T and volume V, i.e., 
the system considered is in an isothermal surrounding 
with fixed volume. For simplicity, the concentration of 
every substance is assumed to be independent of its po- 
sition, and there is no external input or output of me- 
chanical energy. 

Let kij be the first-order, or pseudo-first-order rate 



constants for reaction R; 



Ri. Assume one of them 



is involved in the energy source, i.e., ATP and ADP: 
ATP + i?i k M ADP + R 2 , 

where ki 2 and k 2 \ are both second-order reaction con- 
stants, and fci2 = k\ 2 [ATP], k 2 \ = k 2 i[ADP] are pseudo- 
first-order rate constants. 

Let Ci be the concentration of Ri. Then by the law of 
mass action, such a linear system could be described in 
terms of a mathematical model 



dcjjt) 
dt 



= £(< 



(8) 



If there is no external mechanism to keep the concen- 
trations of ATP and ADP, then the time evolution of 
[ATP] and [ADP] is 



dcr 
~dT 



~dT 



-k\ 2 CTC\ + k 21 c B c 2 . 



(9) 



Classical equilibrium thermodynamics for closed chemi- 
cal system tells us that there is a unique dynamic and 
chemical equilibrium {c{ q , c 2 q , ■ ■ ■ ,c e ^, a? , c^} which 
satisfies the detailed balance condition c^ka = c eq ka, 



(7) where k\ 2 — k\ 2 c^ and k 2 \ = k 2 \c 
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Each species has a chemical potential Hi{ci) = /j,® + 
kT In Cj, and when a system reaches chemical equilibrium, 
the chemical potentials of different components are the 
same, i.e. Pi(c^ q ) = ^-(c^ 9 ), and pi{c\ q ) + Mr(cy) = 

M2(c2 9 ) + M-d(c^), where /Ut(ct) = Mt + A;T In ct and 
Hd(cd) = A 4 ?) + fcTlnco are the chemical potentials of 
ATP and ADP respectively. /u? is the internal chemical 
potential of species i?^ and obeys the Boltzmann's law 
jU? = — fcTlnc^ 9 +const. 

Detailed balance gives the relation between ^°'s and 
kij 's of the system 



Mi 



A*2 



Mt — Mzj = m 



fcTln^H. 
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Thermodynamics of nonequilibrium driven sys- 
tem — With the presence of an external regenerating 
mechanism, the concentrations of ATP and ADP would 
be kept invariant. The system is not at equilibrium in 
general @. Recall that each /i° could be decomposed 
into h° — Ts°, hence for each individual occurrence of 
the transition Ri — > Rj, the heat dissipation is h® — h® 
which is not related to the regenerating system. However, 
for the real driven reaction ATP + Rx ^ ADP + R 2 , the 
total heat dissipation should be {h\ + ^t) — (h% + (J>d) 
following the above analysis. 

Therefore the heat dissipation rate in such a driven 
open system is 



gopen _ go + gopen^ where 5-0 _ Ts?Ci and S open 

— Cj lnci. Then the evolution of entropy becomes 



dS ope 

dT 



^open 



h open , 



production rate [H, 0, Q . Thus the free energy 



where e° pen 



(12) 



is the entropy 



pi op en jjQ gopen _ gopen 



■ via 



where H° = J^i h^Ci is the enthalpy, and (jP = J^i 
is the internal (conditional) free energy of the system. 

We note that no matter how large the entropic com- 
ponent of [1° is, s° enters both H° and S° pen and they 
compensate, leaving p open invariant If we know 

that = hx{kij/kji) does not depend on tempera- 

ture, i.e. s° is exactly the same for each state, or we do 
not know the temperature dependence of {k^}, then we 
can operationally define "heat" for such a driven system 



h open 



E 



Cjkj 



Cjkji 



(13) 



Note that h°f en and h°^ en are the same at NESS 



which 

imply the heat dissipation in an NESS does not rely on 
measurements based on different resolutions (llj . 

Using Eq. (fT3"|) and the definitions given for S open 
and e° pen , the fundamental entropy balance equation of 
nonequilibrium thermodynamics is recovered 



squation ot 
[ElU HI: 



i>j 

+ (ci(t)k 12 - c 2 (t)k 21 ) (p T - p D ). (10) 
Furthermore, in the stationary NESS: 

~ h nes S 



E ^ 

i>j 

+ {c\ s k l2 



r-Kij -Cf kji) 



E 

l>j 



c s 2 k 21 ) {n T - no ) 
kj 



cf%)ln-^. 



(11) 



The rigorous derivation of (TT2"|) is based on the fact that in 
an NESS, its kinetics and thermodynamics can be decom- 
posed into different cycles [H,I3,[3- As we have stated, the 
regenerating system would not really do any irreversible 
work unless there is a completion of a driven cycle. The 
amount of minimum work that should be done for each 
internal cycle c = {iq — > i\ — > i 2 ■ ■ ■ — > i n — > iq} is just 



dS open 

dt~ 



open _ l 



open 



(14) 



The difference between Eqs. (|12l) and (1141) is that the lat- 
ter is completely independent of the any details on the 
regenerating system, albeit the meaning of "heat" is a 
little obscured without knowing more about temperature 
dependence. This is analogous to an equilibrium ensem- 
ble based on the potential of mean force or conditional 
free energy without the knowledge of their temperature 
dependence [Toj . 

QSS in a large closed system with detailed bal- 
ance — In this case, the concentrations of ATP and 
ADP are very slowly changing; the whole system is 
closed; its dynamical equilibrium is a chemical equilib- 
rium. The total free energy of the system is 
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close 



, CiHi + ctPt + cdud 



d In — + c T In — + c D In — , 
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ki i 1 ki 1 i 2 ■ • • ki n i 



For each state i, the internal entropy Ts" = — 
Thus the entropy of the open system could be defined as 



and which always decreases until it reaches to its mini- 
mum at equilibrium: 



dF c 



dt 



i>j 



(ciki 



(15) 
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Being a QSS, the F close (t) decreases very slowly. The 
term ff ose = —dF close (t)/dt is called free energy dissi- 
pation rate fl2j ]. 

Furthermore, the entropy of the whole closed system 
is defined as S close = J2d~ °i mc «] — c t m c t — cn lncc- 
Then, 

J oclose 

= e f e - ^ ose , (16) 

where = .V.j,,^ - c,- ~ M°) + faka - 

C2fc2i)(MT — /-*£>) * s the heat dissipation, and the entropy 
production rate e c ^ ose = ff ose . The entropy of the sys- 
tem increases due to entropy generated in spontaneous 
processes and decreases when heat is expelled into the 
surrounding. 

One could easily notice, from (|12l) . that e° pen = 
e ciose _ f close This reflects the different perspective 
of Boltzmann/Gibbs and Prigogine: Gibbs states free 
energy never increase in a closed, isothermal system; 
while Prigogine states that the entropy production is non- 
negative in an open system. They are equivalent. 

Relative entropy and housekeeping heat in 
nonequilibrium open driven system — So far, based 
on existing classical thermodynamics, we have obtained 
a consistent picture for NESS and QSS. In fact, one can 
see a distinction between Clausius' and Kelvin's histori- 
cal statements on the 2nd law: The former is about the 
spontaneity of a transient process, i.e. the non-negativity 
of ff ose , while the latter is about a cyclic process with 
non-negative e° pen in a NESS. 

Recently, a more general nonequilibrium thermody- 
namic theory has been put forward for Markov processes 
including master equation systems [iiq . For an open, 
driven system, one has the relative entropy [1, [l2| 

# ({cJIKcr*}) = 5>ln( Cl /cr s ), (17) 

i 

where c" ess is the unique steady state concentrations of 
the system ([5]) . Interestingly, one has several new math- 
ematical inequalities [l2j]: H ({ci}||{c" ess }) > 0; it time 
derivative 

fd = -j t H({ci(t)}m ess })>o; (is) 

and a decompisition fd = e„ — Qhk in which Qhk is called 
housekeeping heat [12], Il3| : 

1 / TtGr-SS 1 \ 

Qhk(t) = -J2 ~ cjkji) In f |^ J > 0. (19) 



For master equation with detailed balance, which cor- 
respond to closed system, Qhk — and the H in (fl~7f is 
precisely the free energy deviation from the equilibrium 
fli ]. and Eq. $TE$ is reduced to ([15]), with f d = e p . 

The novel mathematical results (fl8|) and (fl9|) beg for 
a thermodynamics interpretations in the simple exam- 
ple of motor protein. We have stated the regenerating 
system perform the W m i n amount of work toward the 
system for each internal kinetic cycle. This is a con- 
sequence of 1st and 2nd laws of thermodynamics. One 
can in fact distribute the work input to the system as 
W^ in = ln(4>ikij /4>jkji) for each transition i —> j, i.e. 
substitute {c™ ess } with any other distribution {0;} in 
Eq. [T7] Any set of {&} gives the same W m i n over a cy- 
cle and NESS work input; <pi — Tti, however, is the only 
choice which yields H {{ci{t)}\\{<t>i}) = at the NESS 
and thus being a minimum with respect to variations in 
{ci}. Therefore, the Eqs. (fT5|) and (|19l) implies a prin- 
ciple of minimal H for an NESS. This minimal principle 
requires the work input per transition in the specific form 
of 

W^„=ln(cr s %/cr ss %)- (20) 

The corresponding work input for an ensemble is then 
the Qhk in (fT9]) . In the past, we have suggested to call 
H the fre e energy of a driven system with respect to its 

NESS [13, G3. 

Summarize — A consistent thermodynamic anal- 
ysis is carried out to illustrate the difference between 
closed-system QSS and open-system NESS perspectives 
of nonequilibrium systems. Taking a motor protein as 
an example, the former expects the heat dissipation as 
the Ah° of ATP hydrolysis while for the latter it is the 
A/i. We have shown that the difference of heat dissipa- 
tions between these two perspectives is just the minimum 
work needed for the regenerating system that sustains the 
NESS. The 2nd law in the former is expressed as free en- 
ergy decreasing ff ose > 0, and in the latter is e° pen > 0. 

One can also introduce a "free energy" like H func- 
tion for open, driven systems. It decreases in a system's 
self-organization toward its NESS. The thermodynamic 
concepts of dissipation and housekeeping heat in driven 
system have been proposed for master equation systems. 
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